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Abstract — We consider the problem of identifying a linear 
deterministic operator from an input-output measurement. For 
the large class of continuous (and hence bounded) operators, 
under additional mild restrictions, we show that stable identi- 
flability is possible if the total support area of the operator's 
spreading function satisfies A < 1/2. This result holds for 
arbitrary (possibly fragmented) support regions of the spreading 
function, does not impose limitations on the total extent of 
the support region, and, most importantly, does not require 
the support region of the spreading function to be known 
prior to identification. Furthermore, we prove that asking for 
identiflability of only almost all operators, stable identiflability is 
possible if A < 1. This result is surprising as it says that there is 
no penalty for not knowing the support region of the spreading 
function prior to identification. 

I. Introduction 

Identification of deterministic linear operators from an 
input-output measurement is an important problem in many 
fields of engineering. Concrete examples include system iden- 
tification in control theory and practice and the measurement 
of wireless communication channels. 

It is natural to ask under which conditions on the operator, 
identification from an input-output measurement is possible in 
principle, and how one would go about choosing the probing 
signal and extracting the operator from the corresponding out- 
put signal. This paper addresses these questions in generality 
by considering the (large) class of Unear operators that can be 
represented as a continuous weighted superposition of time- 
frequency shift operators, i.e., the operator's response to the 
signal x{t) is given by 



(1) 



where sh denotes the spreading function of the operator H. 
The representation theorem [[I] Thm. 14.3.5] states that the 
action of any continuous (and hence bounded) linear operator, 
under additional mild restrictions, can be represented as in 
([Til. In the communications literature JJ], ||3], operators 
with input-output relation as in ([T]i are referred to as linear 
time-varying channels/systems and sh is the delay-Doppler 
spreading function. For the special case of linear time-invariant 
(LTI) systems, we have sh{ttV) = h{T)5{v), so that ([T]i 
reduces to 



h{T)x{t — T)dT. 



(2) 



The question of identiflability of LTI systems is readily an- 
swered by noting that the system's response to x{t) — 6{t) is 
given by its impulse response h{t), which fully characterizes 
the input-output relation according to (|2]i. LTI systems are 



therefore always identiflable, provided that the input signal can 
have inflnite bandwidth and we can observe the output signal 
over an inflnite duration. In the general case (i.e., for LTV 
systems), the situation is fundamentally different. Speciflcally, 
Kailath's landmark paper |2| shows that LTV systems with 
spreading function compactly supported on a rectangle are 
identiflable if and only if the spreading function's support area 
satisfles A < 1. Bello lO later pointed out that Kailath's 
identiflability result continues to hold, even if the support 
region of sh is scattered across the (r, i^)-plane, as long as the 
total support area satisfles A < 1. Kozek and Pfander [5| and 
Pfander and Walnut Q provided functional-analytic proofs 
of the resuks in f2l, f3\. Common to [2|, |3|, f5\, f6\ is the 
assumption of the support region of sh being known prior to 
identiflcation. This is clearly restrictive and often impossible 
to realize in practice. 

Contributions: In this paper, we consider the problem 
of identifying deterministic linear operators with spreading 
function compactly supported on an unknown, possibly frag- 
mented, region in the (t, i^)-plane. We do not impose limi- 
tations on the total extent of the support region. Our main 
result shows that an operator with input-output relation ([!} 
is identiflable, without prior knowledge of the spreading 
function's support region, if and only if the total support 
area of sh satisfles A < 1/2. We then show that this factor 
of two penalty — compared to the case where the support 
region is known in advance |2|, [T| — can be eliminated, if 
one asks for identiflability of almost all operators only. This 
result is surprising as it shows that (for almost all operators) 
there is no price to be paid for not knowing the spreading 
function's support region in advance. We discuss the design 
of probing signals and we outline an algorithm which, in the 
noiseless case, provably recovers all operators with A < 1/2. 
Furthermore, we present an algorithm which, again in the 
noiseless case, provably recovers almost all operators with 
A < 1. 

Relation to previous work: Recently Bajwa et al. Q 
considered the identiflcation of LTV-systems with spreading 
function sh supported in a rectangle of area A < 1 and 
consisting of a flnite number of discrete components with 
unknown delays and Doppler shifts. In the present paper, we 
allow general spreading functions that can be supported in the 
entire (r, z^)-plane with possibly fragmented support region. 

Notation: We use lowercase boldface letters to denote 
column vectors, e.g., x, and uppercase boldface letters to 
designate matrices, e.g., X. The superscripts *, ^, and ^ 
stand for complex conjugation, Hermitian transposition, and 
transposition, respectively. The space spanned by the columns 



of X is designated by TZ(X.). The entry in the fcth row 
and kh column of X is denoted by [XJ^j. For the vector 
X, the Euclidean norm is denoted as ||x||^^ and the fcth 
entry of x is [xj^. |f2| stands for the cardinality of the 
set J7. For two sets fii and ^2 we define set addition as 
ill + = : uJi + UJ2, 1^1 G i^i,W2 € ^^2}- denotes 
the Dirac delta function. For a function /(x), supp(/) denotes 
the support set of /. For two functions /(x), g{x.), defined on 
il, we write (/, .g) = /^^ /(x)g*(x)(ix for the inner product; 
11/11 ^yOT) isthe norm of /. 

II. Problem Formulation 

Given normed linear spaced X, Y, we consider linear 
operators _ff : X n- y that can be represented as a con- 
tinuous weighted superposition of translation operators T^, 
with {TTx){t) = x{t — t), and modulation operators with 

{Hx){t)^ I I SH{T,u){M,TrX){t)dudT. (3) 

This is a rather general setting, since according to fT Thm. 
14.3.5], any continuous (and hence bounded) linear operator, 
under additional mild restrictions, can be represented as in (O. 
In the following, denote the linear space of operators that can 
be represented according to (|3) by T-L, and define the inner 
product on this space by 

{Hi,H2)u- {sHt,SH2) = / SHAT,v)s*H^{T,v)d{T,v), 

Hi,H2e n, with the induced norm \\H\\^ = ^(iJ, 

Restrictions on the spreading function: We assume that the 
support region of su has the form 

Mr^ U {u+(kTjl.\ 

(fe.m)er 

where U = [0,T) x [0,1/rL) is a "fundamental cell" in 
the (t, z^)-plane and T e K is a parameter whose role will 
become clear shortly. The set of "active cells" is specified by 
r C S ^ {(0,0), (0, 1), (L- 1)}. Consequently, we 

have Tmax ~ TL and t'max — We denote the support 

area of My as A{My). Given a general support region for 
sh, possibly fragmented and spread over the entire (t, v)- 
plane, we can choose T and L such that this region can be 
approximated arbitrarily well by a support region of the form 
© (see Fig. 

A. Identifiability 

Let us next formally define the notion of identifiability of a 
set of operators Q C H. The set Q is said to be identifiable 
from an input-output measurement, if there exists a probing 
signal X E X such that for each H E Q, the action of the 
operator on the probing signal, Hx, uniquely determines H, 
i.e., if there exists an x £ X such that 

' Since our identifiability proof relies on sending Dirac delta impulses, 
we need to choose X such that it contains generalized functions. To keep 
the exposition simple, we will not dwell on the resulting functional-analytic 
subtleties. Instead, we refer the interested reader to |5_, [6] for a description 
of the ligorous mathematical setup required here. 



kT, — j j C [0, w) X [0, (4) 
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Fig. 1. Approximation of a general support region. 

Byx = H2X Hi^ H2, V ii2 e Q. 



(5) 



Identifiability is hence equivalent to invertibility of the map- 
ping 

Q^Y : H ^ Hx (6) 

induced by the probing signal x. Invertibility alone is typically 
not sufficient as one wants to recover H from Hx in a 
numerically stable fashion, i.e., we want small errors in 
Hx to result in small errors in the identified operator This 
requirement implies that the inverse of the mapping (|6) must 
be continuous (and hence bounded), which finally motivates 
the following definition. 

Definition 1: We say that x stably identifies Q if there exist 
constants < a < /3 < oo such that for all pairs Hi , H2 E Q, 

a\\Hi ~ H2\\^ < \\Hix - H2x\\ < - i/all^- (7) 

Furthermore, we say that Q is stably identifiable, if there exists 
an X E X such that x stably identifies Q. 

Note that ^ is stated in terms of differences of operators, 
since {Hi — H2) is not necessarily contained in the set Q. The 
lower bound in (|7]i guarantees that the inverse of (|6) exists and 
is bounded and hence continuous, as desired. Proving that x 
stably identifies Q essentially amounts to proving that a > 
in Definition[T] The ratio (3 /a provides a measure for the noise 
sensitivity of the identification process, the closer (3 /a to one, 
the better. 

III. Main Results 

Before stating our main results, we define the set of oper- 
ators with Sh supported on a given area Mr: 

UMr ={HEn: supp(sh) C Mr}. (8) 

In this notation, Kailath (2 discussed the case where Mr is a 
(single) rectangle, and Bello f3\ analyzed the case where Afr 
is an arbitrary region, possibly fragmented and spread over 
the entire (r, i/) -plane. We first recall the key results in Q, 
1^ on the identification of Hai^ under the assumption of Afr 
known: 

Theorem 1 Ml?).- Let Mr be given. The set of oper- 
ators "Ha/p is stably identifiable if and only if ^(Mr) < 1. 

In the following, we consider the set of operators 

X{^)^ y -UMr (9) 
.A(J\/r)<A 



which consists of all sets Hmt such that A{Mr) < A. 
Our main resuhs are as follows. 

Theorem 2: The set of operators A'(A) is stably identifiable 
if and only if A < 1/2. 

Note that Theorem |2] applies to the union of all sets of 
operators with spreading function supported on a region with 
area no larger than A, and, in particular, does not need the 
support region of sh to be known in advance. The main 
implication of Theorem [2] is that the penalty for not knowing 
the support region of sh in advance is a factor of two in the 
support set size of the spreading function. We can eliminate 
this penalty by relaxing the identification requirement to 
almost all H G '^'(A). 

Theorem 3: Almost all H e '^'(A) can be stably identified 
if A < 1. 

The factor of two penalty in Theorem |2] has the same 
roots as the factor of two penalty in spectrum-blind sampling 
10, lUl, ifTOl . ifTTl . sparse signal recovery [12], and in the 
recovery of signals that lie in a union of subspaces |[T3l . 
It was recognized before — in the context of spectrum-blind 
sampling — that the factor of two penalty can be eliminated 
by relaxing the recovery requirement to almost all signals ID, 

0, Coi. 

IV. Necessity in Theorem|2] 

To prove necessity in Theorem|2]we start with the following 
lemma which states an equivalent condition on stable identifi- 
ability of X{A). This condition is often easier to verify than 
that in Definition [T] 

Lemma 1: x stably identifies A'(A) if and only if it stably 
identifies all sets 

^Af4,uAfe — {H : H = Hi — H2, Hi e 'Hj\/^,i?2 G ^Mel 

with A{M^) < A and A{Me) < A where $, 8 e S. 

Proof of Lemma \J} Follows immediately by 
invoking the definition of stable identifiability and 
noting that a\\Hi - H2\\-^ < \\{Hi - H2)x\\ < 
P\\Hi- H2\\-^,yHi,H2 e A'(A) if and only if 
a\\H\\^ < \\Hx\\ < I3\\H\\^ for all H e Um^um^ and for 
all M<E,, Me, with A{M^) < A and A{Me) < A, $, 8 e E. 

■ 

Before formally proving necessity in Theorem |2] we com- 
ment on an important aspect of the difference between known 
and unknown spreading function support region. If the support 
region is known and given, by say Mr, and we consider 
the set Hhir^ it follows that the difference Hi — H2 for 
Hi,H2 £ satisfies {Hi — H2) £ Hmt- If we, however, 

consider the set X{A), we have that Hi,H2 € X{A) does 
not imply {Hi ~ H2) £ <%'(A) in general. To see this, simply 
take Hi,H2 € <^(A) such that the support regions of Hi and 
H2 have area A and are disjoint. We do, however, have that 
Hi- H2e A'(2A), Vi?i,iJ2 e ^(A). This observation Hes 
at the heart of the factor of two penalty in A as quantified by 
Theorem |2] 

Necessity in Theorem^ Follows by taking A > 1/2 and 
noting that we can find Af$, Me with A{A'h) = A{Mq) = A 



and Af$nA/e = 0- This implies y^(M$UMe) > 1 and hence 
application of Theorem [T] to the set HMi^uMe establishes that 
Hai^uMq is not stably identifiable. By Lemma [T] this then 
implies that X{A) is not stably identifiable. ■ 

V. Sufficiency in Theorem[2] 

We prove sufficiency in Theorem |2] by finding a probing 
signal that stably identifies A" (A). Concretely, we choose a 
weighted TL-periodic train of Dirac impulses 

a;(t) =^cfc(5(i + fcr), Ck = Ck+L,ykeZ (10) 

as probing signal. The specific choice of the coefficients 
c — {co,...,Ci_i} will turn out to be crucial and will be 
discussed later The main idea of our proof is to 1) reduce 
the identification problem to that of solving a linear system 
of L equations with unknowns, and 2) to apply Lemma 
[U to show that a unique solution of this underdetermined 
system of equations exists whenever A < 1/2 (and c is chosen 
appropriately). 

We start by computing the response of H to x{t) in ( fTol i: 
y{t) = {Hx){t) =Y.''k I SH{t + kT,v)e'^^-'dv. (11) 

Next, define the Zak transform L14J (with parameter TL) of 
the signal u{t) as 

^u(i, /) = ^ ^(t - mTL)e^™^/ 

for (t,/) e [0,TL) X [0,1/rL). The Zak transform of y{t) 
in ( fTTT ) is given by 

Zy{t,f) = 

= ^kf SH{t - mTL + kT, z.)eJ"2-''(*-™^^)dz.eJ2-™T^/ 

feGZ mGZ 

where we used the substitution k' = k — niL and the last 
step follows from the Poisson summation formula. Next, we 
substitute t = t' +pT with p e {0, 1} and t' £ [0,T). 

This amounts to splitting the fundamental rectangle [0,TL) x 
[0,1 /TL) of the Zak transform into L "cells" U, where U 
was defined in Section [III and yields 

Zp{t'J)^Zy{t' +pTJ), {t'J)eU, p = 0,...,i-l 
= E ^ E ^^(^' + ^'^'/ + ^) 

fc=0 m=0 



where we used the substitution k' = p + k and the last step is 
a consequence of sh{t, v) = for (r, v) ^ [0, TL) x [0, 1/T), 
by definition. We can now rewrite the last equation in vector- 
matrix form by defining the column vectors z{t, f) and s(t, /): 



[z(t,/)]p^z,(i,/)e 



-j27rpTf 



p = Q,...,L-l 



and s{tj) ^ [so,o{tJ),SoAtJ),---,sox-i{tJ), 
si,o{t, /), SL-i,L-i{t, /)]^ with 

Sk,m(.t, f) ^ SH {t + kTJ+ ^) eMf+^y. (12) 

It is easily seen that the vector s{t, /), {t, J) G U, fully 
characterizes the spreading function. With all definitions in 
place, we finally obtain 

z{tJ) = A,s{tJ), {tJ)eU (13) 

with the L X matrix 

1 



|Ac,L-l], Ac 



TL 



CcfeF^ 



where [Fjj^ 



p,m — 0, L — 1, and Cc.k is 



the diagonal matrix with diagonal entries {cfe, Ck-i, Ck+i}- 
The proof will be effected by applying Lemma[l] Concretely 
we will prove stable identifiability of Hmo^uMo for all pairs 
M^,Ms with A{M^) < 1/2 and A{Me) < 1/2. By 
setting Mr = U Mq, this is equivalent to proving stable 
identifiability of -Hmp for all Mr with A{Mr) < 1. We 
therefore consider H G Hmt^ note that, by definition 
Sk,m{t, /) = 0, V(fc, m) ^ r. Denote the vector obtained from 
s{t, /) by selecting the entries corresponding to the active cells 
r by sr{t, /) and let Ar be the matrix containing the columns 
of Ac that correspond to these cells. Then (fT3] l become^ 

z{tJ)=ArSr{t,f), {tJ)eU. (14) 

Next, we formally relate (fT4t to the definition of stable 
identifiability through the following lemma, whose proof is 
given in the appendix. 

Lemma 2: Let x be given by dTol l. Then, the bounds a,/3 
in (|7]i for the set of operators T-Lm^ are given as 



inf_^(Arv), = 



/TL sup (Arv). (15) 

l|v||, =1 



The proof of sufficiency in Theorem |2] is now completed 
by showing that for all Mr with A{Mr) < 1, T-Lm^ is stably 
identifiable, i.e., ar > 0. This amounts to proving that Ar 
has full rank for all Mr such that A{Mr) < 1, i.e., for all 
r e S such that |r| < L. What comes to our rescue here is 
a result in fTSl which states that for almost all c, each L x L 
submatrix of Ac has full rank. Hence, there exists a c such 
that ar > for all Mr with A{Mr) < 1. In the remainder of 
the paper, c is chosen such that each L x L submatrix of Ac 
has full rank. 

^ Pfander and Walnut f6\ used the probing signal l llOt to prove that, for 
known spreading function support region, A < 1 is sufficient for stable 
identifiability. The crucial difference between |6| and our setup is that we 
need each submatrix of Ac of L columns to have full rank, as we do not 
assume knowledge of the support region. 



VI. Recovering the Spreading Function 

We next discuss an algorithm for the recovery of operators 
H e .^(A) from the operator's response Hx to the probing 
signal x{t) in ( fTOl l. We start by noting that recovering H 
amounts to recovering sh which by ( fT2] i is equivalent to 
recovering s{t, f) from il3[ . This will be accomplished by 
first identifying the support set of sh, (i.e., the active cells 
of s{t, /)), and then solving the resulting Unear system of 
equations (fT4l i. 

1) Support set recovery: If we assume that A{Mr) < 1/2, 
then the support set F can be recovered from z{t, f) by 
solving: 



(PO) 



{minimize |F| 
subject to z{t, f) = Arsr(t, /), (t, /) G C/ 



where the constraint is over all sr{t, f) with |F| < L/2. 
This is a standard problem, and solutions have been proposed 
in the context of spectrum-blind sampling fSl, f9\, fll|, all 
involving a correlation matrix, which in our setup becomes 
Z ^ Jjj z{t, f)z^ {t, f)d{t, J). The main difference to signal 
recovery in the context of spectrum-blind sampling |8 |, [9|, 
[11] is that here a function of two variables has to be recovered 
rather than a function of one variable. Using (Il4l we can 
express Z according to 



Z = ArSr A^ 



(16) 



where Sr = Jjj sr{t, f)^^ {t, f)d{t, f). Using similar argu- 
ments as in ifTOI. it can be shown that (PO) is equivalent to 



(PO) 



mmimize 



IFI 



\subj 



ect to Z = ApSpA 



p^pAp 



where the constraint is over all Hermitian matrices Sp G 
(j-<|r|x|r| 5jjj(;g 2 is normal, it can be decomposed as Z = 
QQ^, where the R = rank(Z) columns of the matrix 
Q e C^^^ are orthogonal. As shown by Feng ([TOl, (PO) (and 
hence (PO)) is equivalent to 



(PO') 



mmimize 



[^subject to Q = ArGr 



(17) 



where the constraint is over all Gr e Cl^l^-^. (PO') is known 
in the literature as the finite multiple-measurement vector 
(MMV) problenil IHl. Apphcation of CSl Thm. 2.4] ensures 
that (PO') provably recovers the correct support set F as long 
as |F| < L/2, i.e., as long as the area of the unknown support 
set of the spreading function satisfies A < 1/2. 

2) Recovery for known support set: Once the support set F 
has been identified, we solve ( fT4] i for sr{t, /), which based on 
(fT2l) yields sh and hence H. Note that (fT4l i has to be solved 
over the continuum of values (i, /) g U. We can expand all 
quantities in ( fT4b into two-dimensional Fourier series over U, 
which results in a system of countably many linear equations 
to be solved. 

^The MMV problem is usually formulated as follows: Minimize 
subject to Q = AcG, where the constraint is over all G e and 
II Gil n is the number of rows of G that contain at least one non-zero entry. 



VII. Identification for Almost All H e X{A) 

We next prove Theorem|3] The proof is inspired by [|9j Thm. 
1], and is constructive as it specifies the recovery algorithm 
(for almost all H E A'(A), A < 1). The basic idea is to use 
a MUSIC-like ifTTl algorithm based on (fT6] l. which allows us 
to recover F under the following two conditions: 

1) A<1 — 1/L. The penalty of 1/L is technical and can 
be made arbitrarily small by choosing L large enough. 

2) The functions Sk,m{t, f ), {k,m) € F, are linearly in- 
dependent on U, i.e., there is no vector a € C^,a ^ 
Q,N = \T\, such that a^sr(<, /) = 0, V [t, f) e U. 

We recognize that almost all H E X{A) satisfy Condition ID 
Proof of sufficiency in Theorem |5} The proof is effected 
by establishing that, under Conditions [T] and |2] above, the 
support set F is uniquely specified by the indices of the 
columns of U^Ac that are equal to 0. Here, U„ is the matrix 
of eigenvectors of Z corresponding to zero eigenvalues. To see 
this, we perform an eigenvalue decomposition of Z in ( fTSI l to 
obtain 



z = [u, u„] 



A. 




u. 



H 



= ArSpA 



(18) 



where XJ^ contains the eigenvectors of Z, corresponding to 
the non-zero eigenvalues of Z. Lemma [3] in the appendix 
establishes that, thanks to Condition |2] above, for almost all 
H E X{A), Sr has full rank. As discussed in Section |V] 
each set of L or fewer columns of Ac is linearly independent. 
Condition [T] ensures that |r| < L — 1, which implies that Ar 
has full rank for all sets F in question. Hence we get from 
(dill that 

7^(A^) = 7^(A^S^A^) = 7^(U,A,Uf ) = 7^(U,). (19) 

72.(U„) is the orthogonal complement of TZ{\Jz) in C^. It 
therefore follows from ([19) that U^Ar ~ 0. Therefore, the 
columns of U^Ac that correspond to indices {k,m) E F are 
equal to 0. To conclude the proof, we show, by contradiction, 
that no other columns of U^Ac are equal to 0. Suppose that 
U^a — where a is any column of Ac corresponding to an 
index pair (/c',m') ^ F. Then a E 7^(U^) = 7^(A^). This 
would mean that the L or fewer columns of Ac corresponding 
to the indices {k,m) G {F U (fc',m')} would be linearly 
dependent. The proof is completed by noting that this stands 
in contradiction to the fact that — since we assume that c is 
chosen accordingly — each set of L or fewer columns of Ac 
is linearly independent. ■ 

Appendix 

Proof of Lemma |2} Starting from (fl4l i. we get for fixed 
values of {t, f) eU 

-\W{t,f)h, < MtJ)\\,^ < ^||sr(t,/)||,, (20) 



VTL" - " - yjTL' 

with ar, /3r defined in ( fTsT l. Squaring and integrating (|20) over 
U yields 



\Zy{tJ)\^d{tJ) = 



TV 



\Hx\\ 



(21) 



'[0,TL)x[0,l/rL) 

where the last equality follows from the unitarity of the Zak 
transform |14|. Similarly, we have 

/ \\sr{t,f)\\ld{tJ) = \\sH\\' = \\H\\l. (22) 
Ju 

Inserting (|22] | and (ISTT l into (|20] | completes the proof. ■ 
Lemma 3: Sr has full rank if and only if the functions 

Sk,m{t, /), (fc, m) E F, are linearly independent on U. 

Proof: Assume that Sr does not have full rank. Then 
there exists an a 7^ 0,a e such that a^Sr — and 
hence a^Sra = a"sritj){a"sr{tj)f ditj) = 0. 
Since a"sr{tj){a"sritj))" > 0,V(t,/) E U, we must 
have a^sr(t, /) = a.e. on U, which implies that the 
set Sk,m{t, f), {k,m) E F, is linearly dependent on U. 
Now assume that the set Sk,m{t, f), {k,m) E F, is linearly 
dependent on U. Then, there exists an a 7^ such that 
a^sr(t,/)s^(t,/)d(i,/) = 0, and hence, using Sr = 
JjjSr{t, f)s^{t, f)d{t, f), by definition, we get a^Sr = 
which proves that Sr does not have full rank. ■ 
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